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ABSTRACT 

The school district in Saginaw (Michigan) operates a 
supplemental-education delivery system in reading and mathematics 
that consists of elementary and secondary compensatory education. The 
elementary program is both a push-in and pull-out program that serves 
1,819 students in grades one through five. The secondary program is a 
self-contained classroom program involving approximately 621 students 
in grades 6 through 8. Both are funded through Federal Chapter I 
funds. In 1993-94, approximately 2,440 students participated. In 
addition to the overall evaluation of achievement, this product 
evaluation focused on the Thinking Skills program (TSP) in grades 6 
through 8. Two questionnaires, a structured interview, and a 
classroom-observation instrument were used to gather information 
relative to the TSP program. The California Achievement Test served 
as the overall evaluation instrument. Pre- and posttest results 
indicate that the greatest achievement gains occurred in grade 3 for 
reading and grade 2 for mathematics. Teachers had difficulty 
implementing TSP objectives, and participating TSP students still 
show low achievement, especially in reading. Recommendations are 
presented for program improvement. Five text tables plus 6 data 
tables in Appendix A and 12 in Appendix B present study findings. 
Appendix C contains a study checklist, Appendix D is a program 
description, and Appendix E is the 1993-94 Chapter 1/ArticIe 3 
buildings to submit reading and/or mathematics plans of improvement. 
(Contains 1 references.) (SLD) 
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Program Description 

The School District of the City of Saginaw operates a supplemental 
educational delivery system in reading and mathematics consisting of two 
programs - elementary and secondary Conpensatory Education (CE). The 
elementary CE is both a push-in program (that operates in the regular 
classroom) and a pull-out program (periodically taking students out of regular 
classrooms) that serves 1,819 students in grades one through five. The 
secondary CE is a self-contained classroom program which involved 
approximately 621 students in grades six through eight. The CE programs are 
funded by both the Federal Education Consolidation and Irrprovement Act (BCIA) 
Chapter 1 and Article 3 of the State School Aid Act. 

Summarized in Table 1 below are demographic characteristics that describe 
both the elementary and secondary levels on CE in greater detail. 
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As can be seen from Table 1 above, the primary purpase of the programs is 
to improve the reading ard mathematics achievement''' of a designated number of 
educationally disadvantaged children. The children in the program are 
screened for entry with the California Achievement Tests — Fifth Edition 
(CAT-5)» This year approximately 2,440 pupils are participating in the 
conpensatory education programs (see ^pendix A for counts of pupils by 
building and grade' . 

This year there were six other program cauponents in addition to the 
basic CE programs that were added to the overall program. These components 
included the following: Home-School Aides; Staff Development; Pupil Service 
Team; Elementary After-School/ Extended Day Program; Secondary After-School 
Tutorinig grades 7 and 8; and Project Success. A description of each of these 
six coftponents can be found in Appendix D. 

The broad goals of these programs were to: 1) provide intensive acaiemic 
instruction to the educationally disadvantaged, 2) involve parents in the 
program, 3) supply students with incentives for academic achievement, 4) 
operate staff inservice programs, 5) measure academic growth, and 6) prepare 
students to effectively meet the academic conpetition of the general 
classroom. These goals were the focus of the Compensatory Education 
Department's activities throughout the 1993-94 school year. 

The focus of this product evaluation is upon the Thinking Skills Program 
(TSP) in grades 6-8. Table 2 below presents the gains and losses of the 
program over the past three years. 



The Thinking Skills Program (TSP) is designed to increase thinking 
skills of sixth through eighth graders in such a way that basic skills 
(reading and mathematics) and social confidence also increases substantially. 
See /^pendix C for a checklist for middle school principals interested. 
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Procedures for Evaluation 



Both process and product evaluations were undertaken for the cotrpensatory 
education delivery system. This year's product evaluation efforts focused on 
secondary CE program in grades 6-8. The program is in its fourth year of 
inplementation and termed locally the Thinkir^ Skills Program (TSP) or 
nationally the Higher Order Thinking Skills (HOTS) prcxjram (see Appendix C for 
a checklist for middle school principals interested in HOTS for a further in- 
depth operational description). TWo questionnaires, a structured interview 
guide and a classroom observation instrument were used to gather information 
relative to the TSP program. All TSP teachers and their students were to be 
surveyed and each principal/assistant principal for instruction at the four 
middle schools were interviewed plus each conpensatory education classroom 
teacher involved with the prajram was also observed. The results of these 
pnxiess activities were presented in a separate report published ard 
iissominata^ earlier in the year. 

The product evaluation, which is the focus of this report, aidresses the 
results of student test performance. The California Achievement Tests (CAT-5 
Form A) for grades 1-12 served as the evaluation i instruments. These tests 
were administered in the Spring, 1993 (pre-test) and in Spring, 1994 (post- 
test) . 

Mean pre- to post-test score comparisons were usai to evaluate the 
effectiveness of the "delivery system. The agreed upon standard was an 
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inprovement greater than three nomial cutrve equivalent (NCE) points froti pre- 

to post-testing." The reading (both basic and advancei skills) and then the 

mathematics (both basic and advancai skills) results for the entire CE 

3 

delivery system will be presented. 



A NCE is very similar to a percentile rank (ranging £ran 1 to 99 with a 
mean of 50) with the additional a3 vantage of being based on an equal interval 
scale. Federal and State educational officials are increasing by requiring 
that outcome staniards for compensatory- education students l^e expressed in NCE 
units. The 1991-92 School Aid Act set the stanjarfs Eor student aai school 
average gains to exceed two NCE units for 1991-92 and to exceed three NCE 
units for 1992-93 an3 subsequent school years. 

The use of advancerl skills as a means to evaluate the progress of CE 
students represents a major change from past evaluation requirements which 
only required basic skills in reading ani mathematics to be evaluated. Tlie 
administrative rules that required the measurement of advancai skills also 
required "plans of improvement" from Chapter 1 buildings experiencing an 
average gain of three NCEs or less in one or more skill/subject areas served. 

5 
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Presentation and Analysis of Data 

The primary goal of conpensatory education was to increase reading and 
mathematics achievement in both basic and advanced skill areae. The data 
presented in this section will indicate the extent to which this goal was 
achieved ♦ Reading and then mathematics data by grade are presented below. 
v^ere relatively few students were tested at any grade level and for a 
building, the results should be viewed with caution . 

Tlie achievement results by school for the entire program and each funding 
source separately are presented in Appendix B. 

Product Data: Reading Basic Skills 

Ihe pre- and post-test results for total reeling are presented in 
Table 2. 

l^le 2 

Attainment of the Perforroance Standard for Total Raaiing 







Normal Curve Equivalents 




Comparisons 
tf/ Grade 


# of Stidents 
Pre- to Post- 
Ttested 


Pre 
Mean 


Post 
Mean 


Mean 
Gain 


Perfonn£inge 
Standard 
Attained 


2 
3 
4 


215 
238 
0 


27.9 
25.2 


27.2 
28.4 


-0.7 
3.2 


No 

Yes 


5 
6 
7 
8 


0 

142 
145 
114 


24.9 
28.3 
30.5 


25.0 
29.3 
29.9 


0.1 
0.5 
-0.6 


No 
No 
No 



btote. N = 854. 

Post-test NCE scores will evidence an improvement of more than three NCE 
points over pre-test scores. 
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A study of the reading results shows that students met the performanr;e 
standard at third grade v^ith a gain of 3.2 NCE points between pre- and post- 
testings. At the second grade level/ the score indicated the largest average 
loss of -0.7 NCE points. See impend ix B for the test results by building and 
funding source* 

Product Data; Beading Advanced acills 

The pre- and post-test results for reading comprehension are presented in 
Table 3. 

Table 3 

Attairaient of the Performance Standaid for Reading Ccnprehension 







Nortnal Curve Equivalents 






# of Students 








Performance 


Comparisons 


Pre- to Post- 


Pre 


Post 


Mean 


Standard 


by Grade 


Tested 


Mean 


^5ean 


Gain 


Attained 


2 


215 


29.4 


23.4 


-1.0 


No 


3 
4 


233 
0 


26.3 


31.0 


4.7 


Y'^s 


5 
6 


0 

142 


28.8 


27.3 


-1.5 


No 


7 


145 


34.9 


32.9 


-2.0 


No 


8 


114 


36.3 


31.6 


-4.7 


No 



Note. N = 857. 

^ost-test NCE scores will evidence an iirprovement of more than three NCE 
points over pre-test scores. 



A review of the advanced skills in reading results show that students 
attained the performance standard at secord grade with a gain of 4.7 NCE 
points. At the eighth grade level the scores revealed the largest loss 
of -4.7 NCE points between pre- and post-testirgs. See Appendix B for the 
test results by build irg and funding source. 

7 
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Overall in the area of readirg the standard that post-test NCE scores 
will exceed three NCE units was attained in only 2 of 10 (20.0%) grade levels 
for both basic reading skills and advanced reading skills respectively. The 
administrative rules that required the monitoring o£ progress in both 
basic and advanced skills also required "plans of improvement" from 
buildings experiencing aggregate gains of three NCE units or lesst in one or 
more skill areas served. See impend ix E for a listing of buildings that may 
need to develop a plan of improvement. 

Product Data; Mathematics Basic Skills 

Table 4 below presents the attainment of the performance standard for 
spring to spring data in grades 2-8 in total mathematics. 

Table 4 

Attainiient of the Performance Standard for Tbtcil Mathamatics 







Normal Curve Bquivcdents 






# of StuJents 








Performance 


Corapcirisons 


Pre- to Post- 


Pre 


Post 


Mean 


Standard*^ 


by Grade 


Tested 


Mean 


Mean 


Gain 


Attained 


2 


328 


23.5 


32.1 


8.6 


Yes 


3 


234 


27,4 


32.0 


4.6 


Yes 


4 


116 


22.2 


26.1 


3.9 


Yes 


5 


158 


26.9 


28.3 


1.4 


No 


6 


108 


27.2 


28.4 


1.2 


No 


7 


80 


26.8 


26.4 


-0.4 


No 


8 


61 


28.4 


28.1 


-0.3 


No 



Note. N = 1,085. 

Post-test NCE scores will evidence an improvement of more than three NCE 
points over pre-test scores. 



A review of total mathematics results reveals that students met the 
performance standard in second, third, and fourth grades. The gain at the 
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second grade level, indicated the largest NCE inprovement (8»6 points) between 
pre- and post-testings. At the seventh grade, the smallest acceptable 
positive NCE gain (-0.4 points) was observed. See Appendix 3 for the test 
results by building and funding source. 

Pra3uct Data; Matheatnatics Advanced Skills 

Table 5 below presents the attainment standard for students in grades 
2-8 in mathematics concepts and applicatioas. 



Table 5 

Attainment of the Perfomanoe Standard for Mathematics Cbncepts 
and Applications 







Normal Curve EStjuivalents 






t of StiiJerits 








Performance 


Conparisons 


Pre- to Post- 


Pre 


Post 


Meein 


Standard^ 


by Grade 


Tested 


Mean 


Mean 


Gain 


Attained 


2 


328 


30.9 


32.9 


2.0 


No 


3 


234 


32.0 


30.6 


-1.4 


No 


4 


116 


25.8 


27.8 


2.0 


No 


5 


158 


30.2 


29.6 


0.6 


No 


6 


108 


32.0 


29.3 


-2.7 


No 


7 


80 


29.3 


26.6 


-2.7 


No 


8 


61 


28.3 


29.5 


1.2 


No 



Note. N = 1,085. 



Post-test NCE scores will evidence an improvennent of more than three NCE 
points over pre-test scores. 



A study of the advanca^ mathematics skills results show that no grade 
level group of students attained the perfomance standard. At grade two and 
four, the largest positive gains (2.0 NCE points) were observed. At sixth ard 
seventh grade levels the largest negative NCE gains (-2.7) can be observed. 
See Appendix B for the test results by building and funding source. 



Overall in the area of mathematics the standard that post-test NCE scores 
will exceed three NCE units was attained in 3 of 7 (42.8%) and 0 of 7 (0.0%) 
grade levels for basic and advanced mathematics skills respectively. The 
administrative rules that required the monitoring of progress in both basic 
and advanced skills also required "plans of improvement" from buildings 
experiencing aggregate gains of three NCE units or less in one or more skill 
areas served. See Appendix E for a listirg of build irvgs that may nee5 to 
develop a plan of iiiprrovement. 
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Sunioary and Conclusions 

The Chapter 1 ard Article 3 Conpensatory Eaucation (CE) programs were 
designed to provide direct instructional services in reailing and matheiiiatics 
to some 2,440 students in grades one through eight, ihe main intent of the CE 
programs were to inprove the pupil's reading and /or mathematics achievement • 
Instruction occurred primarily in small group settings outside of the regular 
classroom (pull-out) or push-in (that operated in the regular classroora in 
grades one and two) for CE at the elementary level, and in a regular classrooxi 
setting with a reduced number of students for CE at the secondary level • 

The results of the pre- to post-testing of compensatory education 
students by grade indicate the overall greatest gains and attainment of the 
performance standards in reading were made at the third grcde level, 
Mathematics gains were the greatest at grade two and the attaiament of the 
performance cx;curred in grade 2 for total mathematics. 

The 1993-94 compensatory education -delivery system showed three increases 
from the previous years in terms of the percentage of grade levels meeting the 
standard. The chart below summarizes these charges. 



Percent Attaining Standard 



Area 


1992-93 


1993-94 


Change Status 


Basic Reading 


9.1% 


20.0% 


Increase 


Advanced Reading 


9.1% 


20.0% 


Increase 


Basic Mathematics 


27.3% 


42.8% 


Increase 


fldvanceii Mathematics 


0.0% 


0.0% 


Unchanged 



The increases shown in reading have probably come about by the use of the 
reading recovery program at grade one and the use o£ literacy groups in grades 
two anJ tiiree. Likewise programatic changes have been started in mathematics. 
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These new programs hopefully will, with time and proper revisions, allow us to 
make gains of more than three NCEs for all students in each subtest area* 
This process of program irrprovement deserves our attention such that gains in 
student achievement will become a reality. 

The new evaluation rules that required focusing the evaluation of both 
Chapter 1 on basic and advanced skills also required "plans of improvement" 
from buildings experiencing three NCE units or less in one or more skill/ 
subject areas across all grades served* See Appendix E for a listing of 
buildings that may be required to submit a plan. 

A series of recommendations follow that are offered in an effort . to 
stimulate further program ref inements/irrprovements. 



nsooDiDendatlons 



The recommendations that follow are based on this year's process and 
prxduct evaluations and are intended to help bring about Chapter 1/Article 3 
program iitprovements in the following school year. 

Ihe ideas and techniques offered below stem from a perceived problem(s) 
and are just one of many ways to inprove the performance of the prc^ram. As 
solutions are sought for optimum program operations, a dialogue/discussion 
should be undertaken to determine the best and most workable way to solve the 
perceived problem(s). The staff and evaluator should be broight into these 
discussions so that all involved feel part of the proposed new operation of 
the program. 



• Reduce variations in the program between building 
sites by having the director and compensatory 
education staff analyze the building results pre- 
sented in Appendix B . Ihis analysis process should 
also involve building leaders arvl school improvement 
beams . Hopefully, a plan can be formulated to 
reduce (or control) these variations in program 
inqpact. 

• Program leadership should determine why approximately 
25% of the teachers had difficulty iirplementing TSP 
methods and potential remedies to make future full 
iitplementation easier. 

• Participating TSP students still show low achievement 
levels especially in the ixrea of reading. To allow 
the TSP program to better show achievement in reading, 
irtplementing optional program elements by TSP staff 
such as writing and answering eight questions at the 
end of each unit, etc. may be necessary. 

• There should be a priority given to building in monies 
for the purchase of additional TSP computers/printers 
and related supplies in next year's budget or gettirg 
approval to purchase these computers/printers etc. with 
carry-over funds this school year. 
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• To help promote better understanding and communication 
with regular education teachers and principals, these 
staff members need to be allowed to practice TSP methois 
(meta-ccqnition, decision-making, and problem--solving ) 
within their own classrooms. An inservice session 
relative to these methods/techniques needs to be 
scheduled for all middle school staff members. 

m Steps that are now being planned to help increase the 
chances of all eligible students be scheduled into a 
TSP middle school classroom need to be carried out. 
These steps inclide the following: earlier production 
of updated participant listing, earlier conpletion of 
testing, and more prorrpt reporting of results to middle 
schools, etc. 
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Table 1^1 

Count of Pcograai Participants* for the Ccanpensatory fflucation Program, 
1993-94 



Building 


R 


1 


2 


3 


4 


5 


Ibtal 


E. Baillie 


0 


30 


19 


19 


5 


11 


84 


Coulter 


0 


2 


22 


9 


1 


6 


40 


Einerson 


0 


28 


27 


24 


9 


18 


106 


Fuerbrir^er 


0 


9 


22 


18 


3 


8 


60 


N. Haley 


0 


10 


22 


2 


0 


0 


34 


Hand ley 


0 


0 


0 


0 


0 


0 


0 


Heavearich 


0 


15 


22 


29 


12 


16 


94 


Herig 


. 0 


12 


26 


12 


9 


10 


69 


tloughton 


0 


23 


11 


16 


2 


4 


56 


Jerome 


0 


9 


16 


7 


3 


3 


38 


Jones 


0 


30 


12 


12 


0 


0 


54 


Kenpfcon 


0 


6 


18 


12 


4 


3 


43 


Longfellow 


0 


29 


26 


47 


15 


9 


126 


Longsfcreet 


0 


24 


22 


14 


15 


9 


84 


J. Loomis 


0 


44 


51 


25 


13 


10 


143 


M. Park 


0 


15 


22 


22 


7 


20 


86 


C. Miller 


0 


5 


16 


5 


0 


0 


26 


J. Moore 


0 


14 


20 


18 


2 


8 


62 


Morley 


0 


10 


17 


20 


4 


19 


70 


J. Rouse 


0 


8 


16 


14 


5 


10 


53 


Salina 


0 


14 


16 


19 


5 


1 


55 


Stone 


0 


18 


17 


24 


14 


11 


84 


Vfebber Elem. 


0 


41 


40 


44 


6 


14 


145 


Zilwaukee 


0 


1 


1 


4 


0 


1 


7 


TOTAL 


0 


397 


481 


416 


134 


191 


1,6^9 



*Count as of January 13/ 1994 computer run that included all 
participants. 
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Table A-2 

Count of Program Participants* for the Conpensatory Education 
Program, 1993-94 



Building 


6 


7 


8 


Tbtal 


Central Middle 


73 


63 


53 


189 


North Middle 


39 


36 


23 


98 


South Middle 


41 


43 


59 


143 


Ifebber Middle 


60 


74 


57 


191 


TOTAL 


213 


216 


192 


621 



*Count as of January 13, 1994 computer run that included all 
participants. 
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Table A-3 

Count of Program Participants* for the Chapter 1 Program, 1993-94 



Building 


K 


1 


2 


3 


4 


5 


Tbtal 


E. Baillie 


0 


30 


19 


19 


5 


11 


84 


Coulter 


0 


2 


22 


9 


1 


6 


40 


Elnerson 


0 


28 


27 


24 


9 


18 


106 


Fuerbringer 


0 


9 


22 


18 


3 


8 


60 


N. Haley 


0 


10 


22 


2 


0 


0 


34 


Hand ley 


0 


0 


0 


0 


0 


0 


0 


Heavenrich 


0 


15 


22 


29 


12 


16 


94 


Herig 


0 


12 


26 


12 


9 


10 


69 


Houghton 


0 


23 


11 


16 


2 


■ 4 


56 


Jerome 


0 


9 


16 


7 


3 


3 


38 


Jones 


0 


30 


12 


12 


0 


0 


54 


Kennpton 


0 


6 


18 


12 


4 


3 


43 


Longfellow 


0 


29 


26 


47 


15 


9 


12f 


Longstreet 


0 


24 


22 


14 


15 


9 


34 


J. Loomis 


0 


44 


51 


25 


13 


10 


143 


M. Park 


0 


15 


22 


22 


7 


20 


86 


C. Miller 


0 


5 


16 


5 


0 


0 


26 


J. Moore 


0 


14 


20 


18 


2 


8 


62 


Morley 


0 


10 


17 


20 


4 


19 


70 


J. Rouse 


0 


8 


16 


14 


5 


10 


53 


Sal ina 


0 


14 


16 


19 


5 


1 


55 


Stone 


c 


18 


17 


24 


14 


11 


84 


Webber Elem. 


0 


41 


40 


44 


6 


14 


145 


Zilwaukee 


0 


1 


1 


4 


0 


1 


7 


TOTAL 


0 


397 


481 


416 


134 


191 


1,619 



*Count as of January 13 ^ 1994 conputer run that included all 
participants* 

ER?C " 2-0 
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Appendix A-4 

Count of Program Participants* for the Ch£4)ter 1 Program, 1993-94 



Building 


6 


7 


8 


Ttotal 


Central Middle 


73 


63 


53 


189 


North Middle 


39 


36 


23 


98 


South Middle 


41 


43 


59 


143 


Webber Middle 


60 


74 


57 


191 


TOTAL 


213 


216 


192 


621 



*Count as of January 13/ 1994 corputer run that included all 
participants. 



APPENDIX A 

Table A-5 

Count oil Program Participants* for the Article 3 Program, 1993-94 



Building 


K 


1 


2 


3 


4 


5 


Ttotal 


E. Baillie 


U 


on 


ly 


19 


u 


11 


/9 


Coulter 


U 


I 


11 


9 


0 


0 


39 


Elnerson 


0 




27 


24 


0 


1 o 

lo 


9 / 


Fuerbrirger 


0 


9 


22 


18 


0 


8 


57 


N. Haley 


0 


10 


22 


2 


0 


0 


34 


Hard ley 


0 


0 


0 


0 


0 


0 


U 


Heavenrich 


0 


15 


22 


29 


0 


16 


82 


Herig 


0 


12 


26 


12 


0 


10 


60 


Houghton 


0 


23 


11 


16 


0 


4 


54 


Jerome 


0 


9 


16 


7 


0 


3 


35 


Jones 


0 


30 


12 


12 


0 


0 


54 


Kertpton 


0 


6 


18 


12 


0 


3 


39 


Longfellow 


0 


29 


26 


47 


0 


9 


111 


Lorq street 


0 


24 




14 


0 


9 


69 


J» Loomis 


0 


44 


51 


25 


0 


10 


130 


M. Park 


0 


15 


22 


22 


0 


20 


79 


C. Miller 


0 


5 


16 


5 


0 


0 


26 


J. rtoore 


0 


14 


20 


18 


0 


8 


60 


Morley 


0 


10 


17 


20 


0 


19 


66 


J. Rouse 


0 


8 


16 


14 


0 


10 


48 


Salina 


0 


14 


16 


19 


0 


1 


50 


Stone 


0 


18 


17 


24 


0 


11 


70 


Vtebber Elem. 


0 


41 


40 


44 


0 


14 


139 


Zilwaukee 


0 


1 


1 


4 


0 


1 


7 


TOTAL 


0 


397 


481 


416 


0 


191 


1,485 



*Count of January 13, 1994 cortputer run that included all participants. 
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Table A-6 

Count of Program Participants* for the Article 3 Program, 1993-94 



Biiilriina 


6 


7 


o 




Central Middle 


73 


63 


53 


189 


North Middle 


39 


36 


23 


98 


South Middle 


41 


43 


59 


143 


Webber Middle 


60 


74 


57 


191 


TOTAL 


213 


216 


192 


621 



*Count as of January 13, 1994 computer run that included all 
participants. 
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Table B-5 

Attaiment Status For Chapter 1 Pupils in Basic Skills Total Heading and Mvanced 
Skills Beading Goiprehension 







Grade 6 






Grade 


7 






Grade 


8 




Subject/ 




Normal Curve 






Nonnal Curve 






Nonnal Curve 




School 




Equivalents 






Bcjuivalents 






Equivalents 












Mean 








Mean 








Mean 




Number 


Pre 


Post 


Gain/ 


Number Pre 


Post 


Gain/ 


Number Pre 


Post 


Gain/ 




Tested 


Mean 


Mean 


Loss 


Tested 


Mean 


Mean 


Loss 


Tested 


Mean 


Mean 


Loss 


Total 


























Reading 


























Central 


48 


22.4 


23.1 


0.7 


39 


29.1 


30.5 


1.4 


32 


25.0 


25.7 


0.7 


North 


25 


27.2 


27.8 


0.6 


14 


29.9 


28.4 


-1.5 


7 


32.8 


29.2 


-3.6 


South 


29 


28.5 


32.2 


3.7 


32 


30.3 


32.8 


2.5 


39 


37.3 


36.2 


-1.1 


v/ebber 


40 


23.9 


20.2 


-3.7 


60 


27.6 


26.9 


-0.7 


36 


27.7 


27.0 


0.7 


System 


142 


24.9 


25.0 


0.1 


145 


28.8 


29.3 


0.5 


114 


30.5 


29.9 


-0.6 


Reading 


























Ccqpr^ensior 


























Central 


48 


26.5 


26.5 


0.0 


39 


35.6 


35.2 


-0.4 


32 


31.7 


28.1 


-3.6 


North 


25 


32.3 


30.2 


-2.1 


14 


34.1 


34.2 


0.1 


7 


38.2 


31.4 


-6.8 


South 


29 


31.9 


32.5 


0.6 


32 


35.4 


35.9 


0.5 


39 


44.0 


38.3 


-5.7 


Vfebber 


40 


27.2 


22.6 


-4.6 


60 


34.5 


29.4 


-5.1 


36 


31.7 


27.5 


-4.2 


System 


142 


28.8 


27.3 


-1.5 


145 


34.9 


32.9 


-2.0 


114 


36.3 


31.6 


-4.7 



Note. N = 401 students. 
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Table B-6 

Attainment Statxis For Chapter 1 Pupils in Basic Skills Tbtal Mathematics aid Mvanced 
Skills Mathematics Cono^ts ard i^lications 







Grade 6 






Gcade 


7 






Grade 


8 




Subject/ 
School 




Normcil Curve 
Equivalents 






Normal Curve 
Equivalents 






Normal Curve 
Equivalents 






Number 
Tested 


Pre 
Mean 


Post 
Mean 


Mean 

Gain/ 

Loss 


Number Pre 
Tested Mean 


Post 
Mean 


Gain/ 
Loss 


Number Pre 
Tested Mean 


Post 
Mean 


Gain/ 
Loss 


Total 

Mathematics 


























Central 
North 
South 
Webber 


39 
13 
27 
29 


25.0 
30.8 
27.1 
28.5 


24.2 
39.5 
33.4 
24.8 


-0.8 
8.7 
6.3 

-3.7 


19 
15 
6 

40 


27.3 
28.8 
29.0 
25.4 


26.1 
30.3 
31.8 
24.4 


-1.2 
1.5 
2.8 

-1.0 


20 
5 
13 
23 


28.7 
29.0 
31.3 
26.6 


24.4 
31.2 
36.6 
26.0 


-4.3 
2.2 
5.3 

-0.6 


System 


108 


27.2 


28.4 


1.2 


80 


26.8 


26.4 


-0.4 


61 


28.4 


28.1 


-0.3 


Concepts and 
Applications 


























Central 
North 
South 
Webber 


39 
13 
27 
29 


29.4 
36.0 
32.7 
33.1 


24.4 
40.9 
36.0 
24.5 


-5.0 
4.9 
3.3 

-8.6 


19 
15 
6 
40 


29.3 
30.8 
31.8 
28.4 


25.0 
31.0 
33.1 
24.7 


-4.3 
0.2 
1.3 

-3.7 


20 
5 
13 
23 


28.8 
32.8 
31.9 
25.0 


24.6 
35.8 
39.7 
26.7 


-4.2 
3.0 
7.8 
1.7 


System 


108 


32.0 


29.3 


-2.7 


80 


29.3 


26.6 


-2.7 


61 


28.3 


29.5 


1.2 



Note. N =249 students. 
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Table B-11 

Attaiiment Status For Article 3 Pupils in Basic Skills Totcil Reading anJ Mvanced 
Skills Reading Gampr^dhension 







Grade 6 






Grale 7 






Grade 


8 




Subject/ 




Normal 


Curve 






Normal Curve 






Normal Curve 




School 




Bquivctlents 






Equivalents 






Bquivcilents 












Kean 








Mean 








Mean 




Number 


Pre 


Post 


Gain/ 


Number Pre 


Post 


Gain/ 


Number Pre 


Post 


Gain/ 




Tested 


Mean 


Mean 


Loss 






mm 

Mean 


Loss 






Mean 


Loss 


Tbtal 


























Reading 


























Central 


48 


22*4 


23.1 


0.7 


39 


29.1 


30.5 


1.4 


32 


25.0 


25.7 


0.7 


North 


25 


27.2 


27.8 


0.6 


14 


29.9 


28.4 


-1.5 


7 


32.8 


29.2 


-3.6 


South 


29 


28*5 


32.2 


3.7 


32 


30.3 


32.8 


2.5 


39 


37.3 


36.2 


-1.1 


Webber 


40 


23.9 


20.2 


-3.7 


60 


27.6 


26.9 


-0.7 


36 


27.7 


27.0 


-0.7 


System 


142 


24.9 


25.0 


O.l 


145 


28.8 


29.3 


0.4 


114 


30.5 


29.9 


-0.6 


Reading 


























Ccoprehensioi 


























Central 


48 


26.5 


26.5 


0.0 


39 


35.6 


35.2 


-0.4 


32 


31.7 


28.1 


-3.6 


^Iorth 


25 


32.3 


30.2 


-2.1 


14 


34.1 


34.2 


0.1 


7 


38.2 


31.4 


-6.8 


South 


29 


31.9 


32.5 


0.6 


32 


35.4 


35.9 


0.5 


39 


44.0 


38.3 


-5.7 


Webber 


40 


27.2 


22.6 


-4.6 


60 


34.5 


29.4 


-5.1 


36 


31.7 


27.5 


-4.2 


System 


142 


28.8 


27.3 


-1.5 


145 


34.9 


32.9 


-2.0 


114 


36.3 


31.6 


-4.7 



Note. N = 401 students. 
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Table B-12 

Attainoent Status For Article 3 Pupils in Basic SScills Total Mathematics and Mvanc9d 
Skills Mathematics Conc^ts and Applications 







Grade 6 






Grade 7 






Grade 


8 




Subject/ 




Normal Curve 






Normal 


Curve 






Normcil Curve 




School 




EquivciLents 






Equivalents 






Equivalents 












Mean 








Mean 








Mean 




Nmbeir 


Pre 


Post 


Gain/ 


Number Pre 


Post 


Gain/ 


Nunber Pre 


Post 


Gain/ 




Tested 


nean 


Mean 


Loss 


Tested Mean 


Mean 


Loss 


Tested 


Mecin 


Mecui 


Loss 


Tbtal 


























net v*i jciudi u xuo 


























Central 


39 


29.4 


24.4 


-5.0 


19 


29.3 


25.0 


-4.3 


20 


28.8 


24.6 


-4.2 


North 


13 


36.0 


40.9 


4.9 


15 


30.8 


31.0 


0.2 


5 


32.8 


35.8 


3.0 


South 


27 


32. : 


36.0 


3.3 


6 


31.3 


33.1 


1.3 


13 


31.9 


39.7 


7.8 


Webber 


29 


33.1 


24.5 


-8.6 


40 


28. 4 


24.7 


-3.7 


23 


25.0 


26.7 


1.7 


System 


108 


27.2 


28.4 


1.2 


80 


26.8 


26.4 


-0.4 


61 


28.4 


28.1 


-0.3 


Cbncepts and 


























Applications 


























Central 


39 


25.0 


24.2 


-0.8 


19 


27.3 


26.1 


-1.2 


20 


28.7 


24.4 


-4.3 


North 


13 


30.8 


•)9.5 


8.7 


15 


28.8 


30.3 


1.4 


5 


29.0 


31.2 


2.2 


South 


27 


27.1 


33.4 


6.2 


6 


29.0 


31.8 


2.8 


13 


31.3 


36.6 


5.3 


Webber 


29 


28.5 


24.8 


-3.7 


40 


25.4 


24.4 


-1.0 


23 


26.6 


26.0 


-0.6 


System 


108 


32.0 


29.3 


-2.7 


80 


29.3 


26.6 


-2.7 


61 


28.3 


29.5 


1.2 



Note. N = 249 students. 
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CHECKUST FOR MIDDLE SCHOOL PRINQPALS 
(Conditions Under Which the HOTS Progran^ is Effective for Chapter 1 and LD Students) 

HOTS is a general thinking skills program designed primarily for Chapter I and mildly impaired 
Learning Disabled students in Grades 5-8. The thinking skills are designed to also enhance social in- 
teraction and basic skills. HOTS students are currendy out-performing national averages for basic skill 
gains in reading and nuth, and the program has been validated by the National Diffusion Network. 

HOTS represents a new approach to compensatory education. Instead of reteaching the informrton the 
students did not previously learn, HOTS provides the types of thinking skiUs that students need to be 
able to learn content the first time it is taught in the classroom. Producing basic skill gains, however, 
requires implementing the program in accordance with the recommendations that follow. 

1. HOTS requires a very good teacher. A weak teacher simply cannot be successful. The 
pedagogical techniques are very sophisticated. The ideal teacher is someone who is very 
bright, energetic, flexible yet organized, and who above all loves to get kids to talk 

2. HOTS requiiies a good orerall school improvement effort in the regular classroom. HOTHS is 
designed to help a good, or imppDving, school get better, HOTS should not be implenr^ited 
in a school with a weak staff, or where extensive school improvement has not already 
taken place. SirKe HOTS does not teach content, if the needed ontcnt is not covered in the 
regular classes, basic skills scores will not go up. This means high time-on-task, and 
quality direct instruction each day in reading and math activities aligned with test 
objectives; 

3. Proper scheduling. The HOTS program is designed to substihite for, and replace , the 
remedial activities in the school. It needs a minimum of 35 minutes of instruction a day, 4 
days a week, on an ongoing basis for 1 i— 2 years. This can be done either as a p\illout or as 
a separate coiuw. Schools that want to raise math scores can optionally use the fifth day, 
or 10-15 minutes at the end of each period, for computeriial math drill and practice. 

Students should ideally be kept in the program for 1 i— 2 years, even if they tot out at the 
end of the first year. Thia extra service is legal and helpe students automate their new 
problem solving skills. Hist and second year HOTS students should be in separate sections. 

Students should be put into HOTS at the lowest grade level in the school (or when they 
first aiTive). HOTS can be implemented either with a limited number of students, or as a 
school-wide model serving all needy students at the lowest grade level. 

A teacher can handle up to about 10 students at a tin« with 9 Apple II computers. A teacher 
and aide can handle up to about 16 students at a time with 13-15 computers.* Other pupil- 
teacher ratios with various combinations of personnel can bf considered. HOTS project staff 
wUl assist in identifying other possible combinational 

* (It*s possible to do the program in the first year with a few lest computers, but only for a 
year.) 

4. Quality, classroom Instnictloa available to HOTS students. It is critical that HOTS 
students get good content instruction in reading and math in their regular classes. 
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Prop« budgeting. G)st$ indudr a) purchaang tht n«ded equiptmnt from local vendom, 
and b) craining and support costSL Tht training and support costs ptr school are as follows: 

Numbg of ^mdgnta grvixl UntoTS 25^ Mom than aS 

First year ♦ $750 $900 $1100 

Second year 300 400 600 

Therea/tar 50 30 100 

• Inclxides the support fee for the school and training one HOTS teacher and 
aide Each additional HOTS teacher adds $450 to the first year costs. (No 
added cost the second year). 

' The support fee includes the curnculixm, phone support, the HOTSTUFF 
newsletter, vidcoupcs» and updates for as long as you use the program. 

6. General support by the priadpaL There are a number of general leadership activities that 
increase the effectivenesa of (he progrant The most important leadership activity is to 
implement and monitor a good overall school effectiveness program. U is also important to 
support the HOTS teacher who will have to work very hard, particularly the first year 
when the oirrlculum and techniques are unfamiliar. Additional support needs include: 

a) HOTS UnJuge activities consist of HOIS students writing aght questions and ar^ 
around a block of content every three weeks. These questions azvi answers are then 
brought to the HOTS lab and entered into the computer to mak« games and quizzes 
based on the content Content teachers interested in working with the students on their 
writing of the questioru in their class should be identified and encouraged to work with 
the HOTS students. 



b) Schedule presentations about HOTS for the entire staff early in the school year. This 
includes a 15 minute video overview of the prognun, and a 1 i^l hour workshop to 
train content area teachers on how to help students write questions^ The latter should 
be conducted within the flrst three tiwnths by tte HOTS teachff. 

c) Support public display of the HOTS stixdcnts* pro%i^ese. 

7. Eraluatlaf HOTS Instxuctioau DO NOT USE EH EVALUATION TECHNIQUES, HOTS 
lessons are diffemt The best measure of the HOTS tsadwr's eff«tiverMSs is the number of 
coapleM answen he/she obtains from studnts— a;s opposed to otm word answers— without 
giving obvknishints^ The more one*word answers or hints» the weaker the lesson* There 
should be little talk by the teacher, and a lot by the students. 

DO NOT WORRY IF EARLY IN A UNIT STUDENTS SEEM CONFUSED ABOUT HOW 
TO PROCEED. Learning to use textual ix\/onnatk3n to deal with uncertainty is one of the 
key skills that HOTS develops. The students will b« successful by the end of the unit 

Feel free to contact Dr. Stanley Pogrow if you have further questions. Dr. Pogrow can be reached at 
Univcnity of Amona* College of Education, Tucson A2 a5721 or at (602) 621-im 
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1. |«TWJCTKP^«MPON©*T (Q«>ortyONe 



□ 

Q 11 ■Mill II I nun 

Q tUBtWTAIIt MATWtMATICa 



Q tlCOMOAUt AiAOUM 

fxl Omt (•••44»T» . MnmP-SchOOl Aii^SS 




PROGRAM LOCATXDNS 

SCM00U9 SIRVCO: 



See list of eligible buildings on 
Page '2. Item A3. 



aHAOS LCVItt ttMVCO 



_ I •> 



3 OESCRIPTTCN OF PROGRAM SERVrceS □ o-..- -m-- c. 

parent-tlacher meedngs. ^^^^^^^^r^^^^^J^f,^^^ teachers mth mathematics and reading 
Chapter 1 students, and assisting the Chapter 1 and regular aass 
activities for Chapter 1 smdents. 



AVERAGE WEBCY SeWHJ 

5. COOROINAHON PLW^ 
T.. C^p« , Hom^Sc^. A.d« wm work w,e, bo.h Q-p^ ',"^,XT^^"rct' 

building staff. 
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L MOQflAlf 



t. M&IHUtnQULQQUPOIsefr (CMortyONE) 

Q n "■WTAat RtAMWa Q SCeOWOAMY MATNCHATieS 

□ •^^•••^^^^ ^] OTH<i ify) Staff Develoonent 



PROGRAM LOCATIONS 

tCH00i.t StAVtO: 



3ee list of eligible buildings on 
Page 3, Item A3- 



QIIAOt LtVtLS UffVCO: 

1-12 



3. DESCRIPTION OF PROGRAM SERVCeS 

In mathematics, various inservice sessions at grades 1-6 will be con- 
ducted focusing on math manipuiatives. In addition, some elementary 
teachers w^ll be tramed in the Reading Recovery TOthod. Chapter I 
teachers in grades 7-9 will receive mformauon and strategies related to 
the Thinking Skills Program. 



4. AVERAGE WEa^.YTlWeSERVQD 



1 COORDINATION PLM4 

In nruthcmatics, Clupter 1 teachers and classroom teachers will iristruct students together in the classroom at 
grades 1-6 on a voluntary basis. As a reault of the training received, Chapter 1 and classroom teachers will 
instruct students using the same infonnation, strategies and materials* 



6. PTE CHAPTER 1 STAPF a4PL0YE0 IN TTHIS COMPONENT 

o^^^* {4%^fit^t Reading RecovQrv Tpflrher Trflin^p 
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1. 



PflOGflAM LCXATTGNS 



Se€ list of eligible buildings on 
Page 2, [rem A3. 



ailAOC WIVtLS SiJiVCO 

PreK-l : 



3. OeSCfllFnON of program SSRVICgS 

Pupil Service Teams (consisting of counselors, social workers, and 
psychologists) will be established to provide Chapter 1 student assisunce 
with academic attendance, socio-emotional, and health problems. 
Services will include screening, diagnosis, evaluation, and intervention 
as necessary. In addition, the Pupil Service Teams will assist the farrulies 
of students who have exhibited identified problems and will make 
referrals to appropriate agenaes within the community. 



□ 
□ 
□ 



0m«M« Ml«r ClMtr 



4. AVERAGeWEa<LYTlU6SeRVe: 



S. COOROiNATION PLAN 



The Pupil Service Teams will provide infotmation and training to parents, teachers, and principals on the purpose 
and services available from the teuns. Tha PupU Service Teams will coordinaie their efforts with the Chapter 1 
and regular education teachers to plan and implement alternative instructional methods, techniques, or adjust- 
ments which could bt made in dw cUMroom. Assistance wiU also be provided in dealing with sodo-emononal 
and behavioral probtanti. 



6. FTE CHAPTER 1 STAFF EMPLOYBD IN lh\S COMPONEMT 



JLj__ on»»«-«rt>«i(3.Q FTE CounsPlors. 2.5 FTF Sociftl Wnrkpr^. 9 0 FTE Pr,-- 
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1 N STT HJ Cng n^ OCMPaen- (Ondtoniyog) 



Sec list of eligible buildings on 
i>age 3, Item A3 — Progran is voluntary 



aflAot uivsLi Slavic 

1-6 




□ 

I 1 

The After Schcx)!/ Extended Day Program serves students who partid- 
pate in the Oiapter 1 Program dunng the regular school day. The Lj 
program provides for additional instruction in reading and /or 
mathematics. Entry into the program is based on need. Qass sizes 
range from 5 to 10 and operates for one hour after school, two to four 
days per week. The program focuses m on different approaches, use of 

computers, newspapers, narrative and expository materials, and manipulatives. Learning approaches and 
materials will focus on the development of both basic skills (e.g., vocabulary development, compuution) and 
more advanced skills (e.g., comprehension, concepts and applications). 



0m«I4« ll«^ul«f ClM«f< 



^ rvfter School/cxter 



4. AVERAGEWEBaYTWeSe^VBD 2to4hours 



S. COORDINATION Pl>M 

After School/ Extended Day teachew will reinforce, extend, and support classroom lessons in reading and math- 
ematics and distnct-wide objectives in reading and mathematics at each grade level. 



«. FTECH^frrEfli STAFF EMPLOYED IN THIS CCMPONENT 

-ill T^MMfi Participating teachers ar« paid on an hourly rate. 
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I. momtm 



Q tUUHirrAllt IIAT>4CltATICt 



Secondary After Sctiool Tutonn;^ 



2. PROGRAM LOCATTONS 

ICMOOCl UllVtO: 



Central Jrt I^orth Interrnediatet 
Webt>er Jr. 



ailAOf llVtUl SKViO 

7-9 



3. oescnifnTc»4 OF PRocaRAM services 



□ 
□ 
□ 



The Secondary After School Tutoring Program serves students who partici- 
pate m the Chapter I Program during the regular school day. The 
program provides for additional instruction in reading and /or 
mathematics. Cass si2es range from 5 to 10 students per teacher and 
operate for one hour after school, for four days per week* Learning 
approaches and materials will focus on the developn^t of both basic 

skills (e.g., vocabulary development compuution) and more advanced skills (e.g., comprehension, concepts and 
applications). 



4 AVERAGE weaaYTTuessTve} 



1 to 4 hours 



5. COOR0tNAT1QNPl>M 



The Secondary After School Tutoring Program will reinforce, extend, and support classroom lessons and distna- 
wide objectives in reading and mathembcs at each grade level. 



FIE CHAPTER 1 STAFF EMPLOYED IN THIS COMPONe^T 

6 r«MMrt Participating teachers are paid on an hourly rate. 
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Q ■imifrMTItAOtMa Q 1IC<SII04«T lUTMtlUTlCt 

□ lUMlTTMT MATKMATiet 0TH«i P^w.^t T,...^ 




Se« list of eligible buildings on 
Page 2» Iten A3. 



a»AM WIVKkt tfUVIO 

1-12 



3. DESCniFnON OF PROGRAM SERVICES 



□ 
□ 
□ 
□ 



Project Success will focus m on those students who have not made any 
academic gains in the past two years and for whom a spedal plan for 
assistance must bp developed. Activities will include: establishn^nt of 
study centers in churches and community centers, recruitment of 
business and industry for mentors and an Adopt- A-School Program, 
recruitment of other volunteers to assist with the program, providing 
infonnation and training to parents, and making referrals to other agencies in the community 



Oil»«f Prnjprr ^^.^np..- 



4 AVERAGE WEa<LYT*€SSRVa} 
S. COOf^OINATION PL>N 



Project Success staff will work with Chapter 1, regular education teachers and Pupil Service Team to identify, 
assess, and develop plans for student program improvement for smdents who have not gained in performance 
for the past two yean. 



e. PTE CHAPTER 1 STAFF BUPLOYED IN TVllS COMPONENT 

—5 0»»wn-€rtfc>i l.Q PTE Pi-Qipot Siirr«»« Sn^HiiH^ and 4.fl PT E Outr€«Ch Workers 
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Figiixre B-1 

1993-94 Qiapter 1/Article 3 Buildings to Submit Heading and/or Btetheraatics 
Plans o£ Icqproveoent ^ 

READING .MATHEMATICS 

Basic Mvanced Basic ? ''vanced 

Skills Skills Skills skills 



MIDDLE SCHOOL 



Central Middle XX XX 

North Middle XX X 

South Middle X X 

Webber Middle XX XX 



ELEMENTARY 



Baillie X 

Coulter 

Einerson 

Fuerbringer X 
Nelle Haley X 
Heave nrich 
Herig 

Houghton X 
Jerome X 
Jones X 
Kempton X 
Longfellow 

Longstreet X 
J. Loomis X 
Merrill Park X 
Chester Miller X 
John Moore X 
Morley 

J. Rouse X 
Salina X 
Stone 

^febber Ele. 
Zilwaukee 



X XX 

X 

X X 
X XX 
X X 

X 

X XX 

X X 
X X 
X 

X 

X X 
X XX 
X X 
X X 
X XX 

X X 
X X 

X 
X 

X X 



Note. X = Aggregate gain three NCE units or less. 

^Chapter 1 evaluabion rules require "plans of inprovemenb" from buildings 
experiencing gains of U-iree NCE units or less in one or more skill/ 
subject areas across all grades served. This requirement may not be 
necessary if: 

• The school served 10 or fewer Chapter 1/Article 3 students 
in that year ; 

• The standardized test results for a particular year are 
invalid or unreliable, as a result of measurements-related 
factors such as charging to a newer test edition ; or 



• Other administrative guidelines set forth by the state apply. 
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